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Abstract. Content personalization in educational systems is an increasing research area. Studies 
show that students tend to have better performances when the content is customized according to 
his/her preferences. One important aspect of students particularities is how they prefer to learn. In 
this context, students learning styles should be considered, due to the importance of this feature 
to the adaptivity process in such systems. Thus, this work presents an efficient approach for per¬ 
sonalization of the teaching process based on learning styles. Our approach is based on an expert 
system that implements a set of rules which classifies learning objects according to their teaching 
style, and then automatically filters learning objects according to students’ learning styles. The 
best adapted learning objects are ranked and recommended to the student. Preliminary experi¬ 
ments suggest promising results. 

Keywords: personalized content recommendation; learning styles; learning objects; expert sys¬ 
tems; adaptive educational systems. 


1. Introduction 

The evolution of technology has allowed teachers and students to use the computer as a 
teaching-learning resource. Currently, it is possible that teachers, even without advanced 
computer skills, provide digital lessons. However, classic distance education environ¬ 
ments, in which prevail the traditional teaching model (the same content presented for 
all students), have, according to Brooks et al. (2006), several limitations. 
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Therefore, it is interesting to consider the particularities of each student, who has 
his/her own preferences in relation to learning and, therefore, tends to have a better 
experience of use, when the presentation of content is targeted to his/her student’s 
profile. In this context, approaches for content adaptation in accordance with particu¬ 
lar students characteristics have been proposed (Nat et al., 2010). As a consequence, 
the personalization in learning environments has been widely investigated. The main 
goal of this personalization is to provide more relevant content and information to 
students. 

In addition, technological advances have led to progress in the area of Informatics 
in Education. The incorporation of Learning Objects (LO), defined by the IEEE (IEEE, 
2010), and its metadata standard for Learning Objects (LOM - Learning Object Meta¬ 
data), contributed to this progress. LO are entities - digital or non-digital - which can be 
used and reused for teaching, education or training. 

With respect to educational theories, Felder and Silverman (1988) developed a Learn¬ 
ing Styles (LS) model based on four dimensions, each one with two poles. The student 
preference can be considered balanced for a dimension if there is no clear trend to a pole. 
Also, it can be considered moderate or strong, if there is clear trend of preference for a 
specific LS. The goal of the research conducted by Felder and Silverman (1988) was to 
compare the most common profiles among students and teachers’ teaching mode. The 
main characteristics of this model are presented forward in this work. 

According to Kinshuk et al (2009), the field of LS is complex and many questions 
are still open, including a clear definition of LS. Investigations have been conducted on 
relating LS characteristics to LO characteristics. In order to provide adaptivity, students 
LS have to be known firstly. Therefore, a consistent student model is an important issue 
in adaptive educational systems. 

The high difficulty in manually obtaining the best suited LO to each student, in any 
repository, is based on the fact that there is a wide range of different students with diffe¬ 
rent preferences. This condition can be even more striking when considering LO reposi¬ 
tories that have a high number of objects to be scanned. In this context, the need for an 
effective mechanism to perform automatic correlation between LS and LO is clear. 

Thus, this paper presents a practical approach to effective and automatic recommen¬ 
dation ofLO according to LS, considering the model of Felder and Silverman. This work 
considers the IEEE LOM, and uses it to perform personalized recovering and recom¬ 
mendation of LO according to specific students LS. 

For this, we show that LO delivery, given a student model that define specific learn¬ 
ing preferences, can be automated. The main motivation for this work is the impossibi¬ 
lity to recover and manually recommend LO that best fit each specific student, due to the 
wide variation of student profiles, and the large number of LO that must be analysed. As 
a result, we obtained an automatic and dynamic approach for personalized delivery of 
LO, considering students LS. 

To this end, a detailed analysis was carried out on the properties of each LS in the 
model proposed and described by Felder and Silverman. Furthermore, a detailed study 
of IEEE LOM, including its fields and properties, has also been done, making it possible 
to find out which LOM fields could bring information related to LS in the Felder and 
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Silverman model. From this, an expert system for classification of LO according to LS 
was implemented, allowing the development of a content recommendation system ac¬ 
cording to students LS. 

The remainder of this paper is organized as follows: next section presents the main 
concepts related to our approach. Then, we present and discuss some related work. Con¬ 
tinuing, we present in detail our recommendation approach. After that, we show some 
results obtained from experiments. Finally, it is presented our conclusions, contributions 
and future work. 


2. Theoretical Background 

In this section, it is presented the definitions and concepts necessary for the understand¬ 
ing of the proposed approach. 


2.1. Learning Styles and Student Modeling 


A learning styles model classifies students in accordance to the way they perceive and 
processes information. A learning style can determine how an individual interacts and 
reacts in a learning environment, reflecting their real preferences. There are several mo¬ 
dels that describe ways of classifying a student in a particular learning style (Felder and 
Brent, 2005). Many learning styles models have been proposed, for example, (Entwistle, 
1981), (Felder and Silverman, 1988), (Honey and Mumford, 1992), (Kolb et al, 1984) 
and (Pask, 1976). Each one of these models describe different aspects on how students 
prefer to learn. 

Felder and Silverman (1988) present a theoretical model in which each student can 
be classified into different LS in four dimensions. In this way, each student can adopt 
attitudes and behaviours that are repeated at different times and situations. To meet the 
different learning styles is necessary to use appropriate teaching strategies related to 
various perspectives of learning. In short, LS incorporate individual features for tasks 
like organize, understand, process, remember and thinking in order to learn and solve 
a problem. 

A striking feature of the Felder and Silverman model is that while most models clas¬ 
sify students in fixed types, Felder and Silverman’s model is based on the idea that each 
student has a tendency to one style in each one of four dimensions. The following pre¬ 
sents a brief description of the dimensions and learning styles that make up this model 
(Felder and Silverman, 1988): 

• Perception: classifies the students according to the way they perceive the content, 
which may be sensory or sensitive if they prefer content addressed more con¬ 
cretely, or intuitive, when there is greater preference for more abstract content. 
Sensitive students like facts, data, experimentation, and solving problems by stan¬ 
dard methods; while, intuitive students prefer principles, theories, mathematical 
model and innovation. 
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• Input: also defined as format-presentation, this dimension indicates that a student 
may have a preference for information transmitted visually, and then considered 
visual, or information provided as text or speech, and in this case the student is 
classified as verbal or textual. 

• Processing: also defined as participation, indicates whether a student has more ac¬ 
tive attitudes toward content and therefore, being active in this case; or if a student 
is positioned more passively, being reflective. Active students like practical activi¬ 
ties, group work, discussions and experimentations; while reflective students learn 
through observation, introspectively, in a passive relation with the content. 

• Organization: this dimension classifies students as sequential, if they prefer con¬ 
tent displayed in a progressive way and more restricted view; or as global, whether 
a general view and flexible access is preferred. 

According to Thompson (1996), the main feature of an adaptive educational system 
is the ability of personalization. In this context, Souza (2002) states that the student 
model is considered a critical piece of individualized behaviour in this type of system, 
which strongly depends on how the knowledge about the student is modelled internally. 

Therefore, the student modelling is a critical issue in developing this type of sys¬ 
tem, thus requiring special attention. One of the problems in these systems is to deter¬ 
mine and represent effectively and consistently the information about students, as alert 
Thompson (1996). 

Nevertheless, student modelling can be classified into static or dynamic (Graf et ah, 
2010). Student static modelling refers to an approach in which the student model is 
initialized only once, usually when the student enrols in the system. On the other hand, 
the dynamic approach to student modelling often updates the student information, and 
then allows the system to respond to changes in the student model during the course 
(Graf et al., 2010). Our approach considers a dynamic student modelling, as exposed in 
Section 4. 


2.2. Learning Objects and IEEE-LOM 


Web based teaching-learning environments are increasingly being used to support edu¬ 
cation activities. The development of educational materials in these environments re¬ 
quires creativity, time availability and knowledge on the appropriate technologies. In 
order to minimize the time and effort spent on the development of educational material 
- and thinking of a way to reuse this material - the concept of Learning Objects (LO) is 
a natural choice. 

The IEEE defines LO as entities, digital or non digital, which can be used for tea¬ 
ching. Other authors complement this setting. According to Wiley (2000), LO are digital 
resources designed to support teaching and enable reusing. With the growing demand for 
these types of resources, it was necessary to stipulate a standard for the identification and 
reuse of them. In this sense, organizations like IEEE, IMS Global Learning Consortium 
and ADL (Advanced Distributed Learning), produced specifications and standards to 
address these needs. 
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The IEEE metadata standard for LO, which is called the LOM (Learning Object 
Metadata), is a standard that describes LO in accordance with a commonly accepted 
model, which facilitates interoperability between different content repositories and 
learning systems. This pattern contains a conceptual data schema that defines the struc¬ 
ture of metadata for LO, which is usually encoded in XML. 

Metadata are information about a learning object, whether physical or digital. As 
the supply of LO is growing, the lack of information or metadata about LO occupies a 
critical and fundamental point in the ability of discovering, managing and using them 
(IEEE, 2010). Metadata allows automating the search and recovery of content, which 
can be reused in different learning scopes and systems. They define the minimum set of 
properties required to allow the management, location and evaluation of these objects, 
used to contextualize the characteristics of a particular item of information. 

IEEE LOM brings a diversity of categories of data fields. The Educational category 
was of fundamental importance for this work, just to focus the description of pedagogi¬ 
cal features of learning objects. 


3. RelatedWork 

Some related approaches can be found in (Lopes and Fernandes, 2009), (Milosevic et al., 
2007), (Romero et al., 2007), (Sangineto et al., 2008), (da Silva and Rosatelli, 2006). 

Among these works, Romero et al. (2007) present a component that suggests links 
to customize the user interaction based on data mining algorithms that evaluate the 
student’s log. The component was integrated to the project AHA!, a virtual learning 
environment based on adaptive hypermedia for offering content to students. Recom¬ 
mendations are made based on registered links on the course. However, the relationships 
between LO and student profiles are not carried out in an automated manner, requiring a 
tutor to manually perform the correlation at the registration of objects. 

The work presented by Milosevic et al. (2007) builds learning scenarios according 
to Kolb’s model (Kolb et al., 1984), and associates students LS to LO metadata conside¬ 
ring only Learning Resource Type and Semantic Density fields from LOM’s Educational 
category. 

The system presented by da Silva and Rosatelli (2006) was designed to be used in 
distance learning courses on the web. Therefore, it performs the recommendation of 
content based on knowledge (beginner, intermediate or advanced). The system monitors 
the activities performed by the student and classifies the student. It is from this that the 
classification system performs the adjustment of navigation on employing the conceal¬ 
ment techniques and annotation links. There is no automatic association between the 
links and the learning styles. 

It is important to say that some studies perform analysis on what types of electro¬ 
nic media are more suitable to a particular LS (Franzoni and Assar, 2009). Lopes and 
Fernandes (2009) observed that some instructional actions are more appropriate for a 
learning style than others. It was assigned values in the interval [0,1] to actions, which 
indicates whether an action satisfies a learning style. The work presents an example of 
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this association policy between instructional actions and LS. Yet, Sangineto et al. (2008) 
classifies different types of LO according to the value of the attribute Learning Resource 
Type, from the IMS Metadata Standard. 

Bittencourt and Costa (2011) present some models and tools for building adaptive 
and semantic educational systems, describing a multilayer architecture and a set of on¬ 
tologies and mapping rules to be used in the construction of this type of system. Also, 
Candotti et al. (2006) shows the implementation of a display module adapted according 
to students learning styles, generating different materials according to their profiles. 

Zaina et al. (2012) proposed an approach that considers the LOM fields Interacti¬ 
vity Type and Learning Resource Type to make recommendations. Besides, the authors 
consider 3 FSLSM dimensions: Perception, Input and Processing. The recommended 
LO have equivalent weights. 

In addition, systems such as AHA! (De Bra et al, 2006), KOD (Manouselis and 
Sampson, 2002), LSAs (Bajraktarevic etal., 2003), TANGOW (Paredes and Rodriguez, 
2004), LS-Plan (Limongelli et al., 2009), Manic citepstern2000adaptive, among others, 
have the main focus on providing a learning experience that meets students learning 
styles. For this, they use self-assessment questionnaires, as Index of Learning Styles 
Questionnaire (ILS) (Van Zwanenberg et al., 2000), inferring students learning styles 
without any, or with low level of automation. 

It is important to mention that it was observed in the analysed related work that they 
consider only a subset of LS. Generally, they do not use a metadata standard for LO, or 
they don’t consider a well-known LS model, or both. Therefore, the personalization pro¬ 
cess provided by these approaches must be ineffective. Thus, progress on these aspects is 
a major contribution of this work, which considers all dimensions of Felder and Silver- 
man LS model, and considers the IEEE LOM as metadata standard for LO. 

Finally, the automatic recovery of LO on the web, through their metadata, taking into 
account specific features of LS, is an important research field. Large-scale re-use of LO 
and interoperability in virtual learning environments have been made possible by tech¬ 
nologies of the SemanticWeb (Davies, 2006). SemanticWeb has its basis in extensible 
Markup Language (XML) (W3C, 2010a) and standards for knowledge representation 
such as the Re-source Description Framework (RDF) (W3C, 2010b) and the Ontology 
Web Language (OWL) (W3C, 2010c). The search and manipulation of this interchange¬ 
able knowledge is facilitated by query languages such as XQuery (W3C, 2010d). 


4. Content Recommendation Based on Learning Styles 

Our approach is based on a probabilistic student model, in which LS are automatically 
discovered and evolve over time, as presented by Dor£a etal. (2013). If a self-assessment 
questionnaire is used for initialization of the model, as ILS (Felder and Spurlin, 2005), 
the probabilistic student model can be booted from the data obtained by the question¬ 
naire, considering the proportion of responses scored for each LS inside a dimension. 
If no selfassessment questionnaire is used, the probabilistic student model is initialized 
with 0.50 (cold start - undefined preferences). 
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Therefore, in the approach presented by Dorpa et al. (2013), LS are considered as 
probabilities, and not as certainties. Table 1 shows an example of a probabilistic student 
LS model, according to the approach proposed by Dorpa et al. (2013). In this example, 
the numbers represent the probabilities of preference for each LS in a dimension. Thus, 
in the example, the student has 35% probability to tend to the active style, and 65% 
probability to tend to the reflective style. A detailed explanation on how this model is 
built can be obtained in (Dorpa et al, 2013). This probabilistic model is built from a 
stochastic process, which is used as basis for recommendation of LO on the proposal 
presented in this work. 

The main goal is to automatically adapt the teaching process for each student accord¬ 
ing to LS. In this context, it is observed that automatic recovery of LO in repositories is 
a critical issue for the personalization of the teaching process according to LS. 

For this, the development of this approach followed the following working me¬ 
thodology: 

1. Study and analysis of the properties of learning styles, considering the theory of 
Felder and Silverman. 

2. Study and analysis of metadata fields and values of the IEEE LOM standard. 

3. Definition of which LOM fields allow the classification of a learning object ac¬ 
cording to learning styles in the Felder and Silverman’s model. 

4. Mapping of the relation between these fields and the learning styles in the Felder 
and Silverman model. 

5. Implementation of an expert system for classification of LO according to LS, using 
the knowledge obtained in the previous step. 

6. Implementation of a recommender system for automatic recommendation of LO 
according to students LS, taking into account the LO relevance order for a specific 
student. 

7. Implementation of a prototype for experimentation with the proposed approach. 

In this context, Table 2 presents the relations found between LS and LOM, showing, 

in each cell, which LS is satisfied by a specific value of LOM. This enabled to create a 
system that finds and recommends the best fit LO for a specific student. 

These relations have been found from careful study and analysis of the following 
basis documents: (Felder and Silverman, 1988) and (IEEE, 2010). The first one is clear 
on presenting the main characteristics and preferences of each kind of student, and how 
they prefer to learn. The second one gives details on the LOM fields and its values, and 
provides explanations on the semantics of the metadata. Therefore, these two publica- 


Table 1 

Probabilistic student model in which learning styles are treated as probabilities 


Probabilistic Learning Styles Model 

Processing 

Perception 


Input 


Organization 

Active Reflect. 

Sens. 

Intuit. 

Visual 

Verbal 

Seq. Global 

0.35 0.65 

0.17 

0.83 

0.89 

0.11 

0.84 0.16 





52 


F.A. Dor<;a et al. 


tions and experience in both subjects gave the authors sufficient basis to perform this 
analysis with enough security. 

It is important to notice that a subset of LOM is being used. We have used a minimal 
subset of LOM, which provides sufficient information about a LO in order to recom¬ 
mend it to a student. This subset is enough to characterize a LO according to its teach¬ 
ing style, enabling the system to recommend them appropriately to students. In order to 
properly recommend a LO according to students’ LS, it is necessary to know, at least, 
its structure, format, interactivity type, learning resource type and interactivity level. 
We have concluded this based on the analysis of (Felder and Silverman, 1988) and 
(IEEE, 2010). 

The following four paragraphs summarize the analysis that we proceeded, and ex¬ 
plains the origin of the relations presented on Table 2. 

According to Table 2, sensitive learners must be attended by videos, applications, 
simulations, graphs, indexes, tables and experiments. This is because this kind of LO 
surely brings content addressed more concretely (facts, data and experimentation), 
which is preferred by this kind of student, as stated by Felder and Silverman (1988). 
On the other hand. Intuitive learners have greater preference for more abstract content 
(principles, theories, mathematical models) (Felder and Silverman, 1988). As we know, 
diagrams are usually used to represent abstractions of reality. In this way, this kind of LO 
is considered to be more appropriate for intuitive learners. 

Active learning (e.g., learning by doing) is supported by content that directly indu¬ 
ces productive action by the learner (Felder and Silverman, 1988). Active documents 
include exercises, simulations, questionnaires, exams, experiments, problem statements 
and self assessments. Reflective learning (e.g., passive learning) occurs when the lear¬ 
ner’s job mainly consists of absorbing the content exposed to him (generally through 
text, images or sound). An expositive learning object displays information but does 
not prompt the learner for any semantically meaningful input. Expositive documents 
include essays, video clips, all kinds of graphical material, and hypertext documents 
(IEEE, 2010). Therefore, LO with high interactivity level are considered to be better 
adapted to active learners, while LO with low interactivity level are better adapted to 
reflective learners. 

A student may have preference for information transmitted visually, considered to be 
a visual student, or information provided as text or speech, and in this case the student is 
classified as verbal, as stated by Felder and Silverman (1988). Therefore, we defined that 
material with dominant visual and graphical content, as image, diagram, figure, graph 
and experiments are proper for visual students. Material which have more textual con¬ 
tent, as audio, text, forms, questionnaires, among others, are proper for verbal students. 
Videos and applications commonly mix verbal and visual content. Therefore, they can 
be recommended for visual or verbal students. 

Global students prefer LO with networked structure, and sequential learners prefer 
LO with linear structure (Felder and Silverman, 1988). As sequential learners prefer con¬ 
tent displayed in a progressive way and more restricted view, Table 2 considers LO with 
sequential structure better adapted to this kind of student. In this context, slides are con¬ 
sidered to be better adapted to sequential learners, due to its usual linear presentation. 
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Table 2 

Relations between LS and LOM 


LOM Field 

Content 

Perception 

Input 

Processing 

Organization 

Structure 

collection 






networked 

- 

- 

- 

global 


hierarchical 






linear 

- 

- 

- 

sequential 

Format 

audio 

- 

verbal 

reflective 

- 


image 

- 

visual 

reflective 

- 


text 

- 

verbal 

reflective 

- 


video 

sensitive 

visual 

reflective 

- 




verbal 




application 

sensitive - 

visual 

active 

- 




verbal 




form 


verbal 

active 

- 

Interactivity 

active 

- 

- 

active 

- 

Type 

expositive 

- 

- 

reflective 

- 


mixed 



active 




- 

- 

reflective 

- 

Learning 

exercise 

- 

- 

active 

- 

Resource Type 

simulation 

sensitive 

- 

active 

- 


questionnaire 

- 

verbal 

active 

- 


diagram 

intuitive 

visual 

reflective 

- 


figure graph 

- 

visual 

reflective 

- 


index slide 

sensitive 

visual 

reflective 

- 


tabale 

sensitive 

verbal 

reflective 

- 


narrative text 

- 

- 

reflective 

sequential 


exam 

sensitive 

verbal 

reflective 

- 


experiment 

- 

verbal 

reflective 

- 


problem 

- 

- 

active 

- 


statement 

sensitive 

visual 

active 

- 


self 

- 

verbal 

active 

- 


assessment 

- 

verbal 

active 

- 


lecture 

- 

verbal 

reflective 

- 

Interactivity 

very low 

- 

- 

reflective 

- 

Level 

low 

- 

- 

reflective 

- 


medium 

- 

- 

active 

- 





reflective 



high 

- 

- 

active 

- 


very high 

- 

- 

active 

- 


Using the relations discovered from this analysis, and presented in Table 2, an expert 
system for classification of LO according to LS based on (Felder and Silverman, 1988) 
and (IEEE, 2010) have been implemented. The expert system is composed by a set of 
rules. Two of those rules are following presented. These rules are related to the classifi¬ 
cation of a learning object in respect to its interactivity level. The rules are written in a 
PROLOG like language, and they are presented by Fig. 1. 

Fig. 1 presents the set of rules divided in five sub-sets, according to the LOM field 
that they analyse: Structure, Format, Interactivity Type, Learning Resource Type and 
Interactivity Level. 
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Structure 

Format 

Interactivity Tvpe (IT) 

Learning Resource Type 

Interactivity Level 




(LRT) 

(IL) 

Global(X):- 

Sensitive(X) 

Active(X):- 

Sensitive(X):- 

Reflective(X):- 

Structure(X,"collection"); 

Format(X,"video"); 

IT(X,"active"); 

LRT(X,"simulation"); 

IL(X,"very low"); 

Structure(X,"networked"); 

Format(X,"application”). 

IT(X,"mixed"). 

LRT(X,"graph"); 

IL(X,"low"); 

Structure(X,"hierarchical"). 

Verbal(X):- 

Reflective(X):- 

LRT(X,"index"); 

LRT(X,"table"); 

IL(X,"medium") . 

Sequential(X):- 

Format(X,”audio"); 

IT(X,"expositive"); 

LRT(X,"experiment"). 

Active(X):- 

Structure(X,"linear"). 

Format(X,"text"); 

IT(X,"mixed"). 


IL(X,"medium"); 


Format(X,"video"); 


Intuitive(X):- 

IL(X,"high"); 


Format(X,"application"); 
Format(X,"form"). 


LRT(X,"diagram"). 

IL(X,"very high"). 




Verbal(X):- 



Visual(X):- 


LRT(X,"questionnaire"); 



Format(X,"image"); 


LRT(X,"index"); 



Format(X,"video"); 


LRT(X,"table"); 



Format(X,"application”). 


LRT(X,"narrative text"); 
LRT(X,"problem statem."); 



Reflective(X):- 


LRT(X,"self assessment"); 



Format(X,"audio"); 

Format(X,"image"); 


LRT(X,"lecture"). 



Format(X,"text"); 


Visual(X):- 



Format(X,"video"). 


LRT(X,"diagram">; 

LRT(X,"figure") ; 



Active(X):- 


LRT(X,"graph"); 



Format(X,"application”); 
Format(X,"form"). 


LRT(X,"experiment"). 





Active(X):- 





LRT(X,"exercise"); 

LRT(X,"simulation"); 

LRT(X,"questionnaire"); 

LRT(X,"exam"); 

LRT(X,"experiment"); 

LRT(X,"problem statem."); 
LRT(X,"self assessment"). 





Reflective(X):- 





LRT(X,"diagram"); 

LRT(X, " figure") ; 

LRT(X,"graph"); 

LRT(X,"index"); 

LRT(X,"slide"); 

LRT(X,"table"); 

LRT(X,"narrative text"); 
LRT(X,"lecture"). 





Sequential(X):- 





LRT(X,"slide"). 



Fig. 1. Rules for LO classification according to LS. 


For example, the rules in the sub-set Interactivity Level state that a learning object X 
is adherent to a reflective student if it has interactivity level very low, low, or medium. 
And, that a learning objects is adherent to a active student if it has interactivity level 
medium, or high, or very high. The rules implement exactly the knowledge presented 
in Table 2. 

For each rule satisfied by a learning object, its relevance is increased by the corre¬ 
sponding value stored in the probabilistic LS model. For example, considering the LS 
model presented in Table 1, if a LO X has medium interactivity level, then it satisfies 
both rules presented above, and consequently, its relevance is increased by 65, conside¬ 
ring that the student has a tendency of 65% to the reflective learning style. In addition, its 
relevance is increased by 35, considering that the student has a tendency of 35% to the 
active style. But, a LO with high interactivity level should have its relevance increased 
only by 35, considering that only the second rule would be satisfied. 

Therefore, the system sums the values obtained by a learning object in each of the 
eight learning styles. Thus, the calculation of relevance R for a LO is given by (1). In (1), 
Q is the number of rules satisfied by the LO, considering a specific LS. LS. represents the 
probability value stored in the student model for the LS i. Therefore, the index i ranges 
from 1 to 8. 

R^&xLS,) 


( 1 ) 









An Automatic and Dynamic Approach for Personalized Recommendation ... 


55 


From this, the system automatically recommends LO that have some level of re¬ 
levance to the user profile. The end result is a list of LO, sorted by relevance, considering 
a specific student’s LS. The most relevant appear on the top of the list. The next section 
presents some experiments and results. 


5. Experiments and Results 

For execution of experiments, a LO repository was simulated through a relational da¬ 
tabase. Experiments were performed using the probabilistic LS model, as proposed by 
Dorqa et al. (2013). For all experiments, the subject of study was Sciences and Arts. 
The prototype for experimentation is shown in Fig. 2. The prototype allows the user to 
performing up the entry of the student’s probabilistic LS, and shows the recommended 
LO sorted by relevance. 


5.1. Experiment 1 


In this experiment, we considered the following probabilistic values for LS: Sensitive 
0.70; Intuitive 0.30; Visual 0.55; Verbal 0.45; Active 0.1; Reflective 0.9; Sequential 0.8; 
Global 0.2. Fig. 3 presents the result - the learning objects recommended for this profile, 
duly ordained by relevance according to the student’s LS. 

As we can observe, the learning object with code 8 was the most adherent to the 
student’s LS. This LO has a relevance value of 510 according to (1). It is possible to 
notice that considering the LS visual, the field Format is met (video), and adds 55 to 
the relevance of this learning object. For the verbal style, the value video in the field 
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Learning Objects 


Id 

Title 

Description 

Keywords 

Structure 

Format 

Interactivity 

Learning 

Resource 

Type 

Difficulty 

eJL 

2 

BBC Beasts: Fossil Fun - 
Skeleto... 

The aim of the game is to 
constr... 

Sciences: Biology: Zoology 


text/html 

N/A 

N/A 

N/A 

285 

3 

Discussions for Learning in 
Larg. 

This is a .seccast on managing 

active learning, oniine 


video/quickTime 

N/A 

N/A 

N/A 

280 

pi 

Altered Cell and Tissue 
Biology 

A graphics-rich. Powerpoint 


N/A 

application/powerPoint 

N/A 

N/A 

N/A 

0 


Fig. 2. The prototype for experimentation. 
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Learning Objects 


Id 

Title 

Description 

Keywords 

Structure 

Format 

Interactivity 

Learning 

Resource 

Type 

Difficulty 

dL 

8 

A Teddy Bear 
Picnic 

This film is about 
a teddy bear 

teddy bear, picnic, run, 
sandwhi. 

linear 

video/quicktime 

expositive 

simulation 

N/A 

510 

5 

Sunspots 

Astronomers used 

the one-metre s. .. 

sunspot solar 
photography. Astro... 

N/A 

image/jpeg 

expositive 

figure 

N/A 

500 

11 

Polynesian Bay 

A photograph of 
a bay near 

Raiet 


N/A 

image/jpeg 

expositive 

figure 

N/A 

500 

14 

i2i 

A girl wearing 
stilts who is fol 

girl, stilts, piano, 
music, musi... 

N/A 

video/quicktime 

mixed 

lecture 

N/A 

475 

9 

David Hoffos 
interview 

a ten minute 

interview with 

Davi... 

education students for 
high scho 

linear 

video/quicktime 

active 

narrative 

text 

N/A 

465 

7 

Working at a 

Dig Site Video 

This short video 

is about indivi... 

paleontology. 
sdq_zone_paleonto.. 

network 

video/movie 

expositive 

exercise 

N/A 

450 

6 

A Virtual Field 
Trip of the 
Land... 

Hop in and join 

Dr Ralph {alias 

Sciences: Biology 
Ecology. Sae 

network 

text/html 

N/A 

graph 

N/A 

440 

12 

Who Killed 

William 

Robinson 9 

William 

Robinson was a 
real pers 

Arts: History: Canadian 
History 

linear 

text/html 

N/A 

diagram 

N/A 

410 

10 

David Hoffos 
residency 

David Hoffos 
working with high 

s... 

education students for 
high scho 

network 

video/quicktime 

active 

lecture 

N/A 

405 

2C 

Polysemy; 
English 1 

This exercise 
helps user to 
deve... 

homophony, polysemy, 
semantics 

linear 

text/html 

N/A 

exercise 

easy 

365 

24 

Phonemic 

Analysis. 

Slovak 

This resource 

provides 

introduce.. 

Slovak, allophones, 
phonemes, ph... 

N/A 

text/html 

mixed 

self 

assessment 

N/A 

335 

25 

Phonemic 

Analysis. 

Spanish 

This resource 

provides 

introduce 

Spanish, orthography, 
allophones 

N/A 

text/html 

mixed 

self 

assessment 

N/A 

335 


Fig. 3: Recommendation of LO resulted from the first experiment. 


Format increases the relevance of the LO by 45 points. Considering the active style, the 
relevance is increased by 10, due to the field Resource Type, which has the value simula¬ 
tion. Relevance is analysed and accounted for each LS. The same process is performed 
for the other LO, resulting on the list presented. 


5.2. Experiment 2 

The student model used in this experiment is: Sensitive 0.70; Intuitive 0.30; Visual 0.55; 
Verbal 0.45; Active 0.1; Reflective 0.9; Sequential 0.2; Global 0.8. In this experiment, 
the student model has the value global greater than sequential. 

This change in the student profile affected the ordering of LO in relation to experi¬ 
ment 1, as shown in Fig. 4. In this experiment, the LO that most meets the student’s LS 
is the one with code 7. What leads to this fact is the field Structure with value networked 
present in this learning object, which is matched by the student’s preference for the 
global style, increasing by 80 the relevance of this learning object. 

The learning object with code 8, which was the most relevant in the previous experi¬ 
ment, appears in fifth. The learning object significantly lost its relevance, due to its linear 
value for the field Structure, which doesn’t meet the supposed student preference. 





An Automatic and Dynamic Approach for Personalized Recommendation ... 


57 


Learning Objects 


Id 

Title 

Description 

Keywords 

Structure 

Format 

Interactivity 

Learning 

Resource 

Tvoe 

Difficulty 

dL 

7 

Worthing at a 

Dig Site Video 

This short video 

is about indivi.. 

paleontology, 

sdq_zone_paleonto. 

network 

video/movie 

expositive 

exercise 

N/A 

510 

5 | 

Sunspots 

Astronomers used 

the one-metre s 

sunspot solar 
photography. Astro 

N/A 

image/jpeg 

expositive 

figure 

N/A 

500 

e 

A Virtual Field 
Trip of the 

Land 

Hop in and join 

Dr. Ralph (alias 

Sciences: Biology: 
Ecology. Scie 

network 

text/html 

N/A 

graph 

N/A 

500 

ii 

Polynesian Bay 

A photograph of 
a bay near 

Raiet... 


N/A 

image/jpeg 

expositive 

figure 

N/A 

500 

14 

i2i 

A girl wearing 
stilts who is fol 

girl, stilts, piano, 
music, musi... 

N/A 

video/quicktime 

mixed 

lecture 

N/A 

475 

10 

David Hoffos 
residency 

David Hoffos 
working with high 

s... 

education students for 
high scho 

network 

video/quicktime 

active 

lecture 

N/A 

465 

8 

A Teddy Bear 
Picnic 

This film is about 
a teddy bear 

teddy bear, picnic, run. 
sandwhi... 

linear 

video/quicktime 

expositive 

simulation 

N/A 

450 

9 

David Hoffos 
interview 

a ten minute 

interview with 
Davi.. 

education students for 
high scho.. 

linear 

video/quicktime 

active 

narrative 

text 

N/A 

405 

12 

Who Killed 

William 

Robinson'’ 

William 

Robinson was a 
real pers 

Arts: History: Canadian 
History 

linear 

text/html 

N/A 

diagram 

N/A 

350 

3 

Discussions for 
Learning in 
Larg.. 

This is a webcast 
on managing 

on... 

active learning, online 
oonferen... 

network 

video/quickTime 

Movie 

N/A 

N/A 

N/A 

340 

24 

Phonemic 

Analysis; 

Slovak 

This resource 

provides 

introduct 

Slovak, allophones. 
phonemes, ph 

N/A 

text/html 

mixed 

self 

assessment 

N/A 

335 

25 

Phonemic 

Analysis; 

Spanish 

This resouroe 

provides 

introduct... 

Spanish, orthography, 
allophones... 

N/A 

text/html 

mixed 

self 

assessment 

N/A 

335 


Fig. 4: Recommendation of LO resulted from the second experiment. 


5.3. Experiment 3 


For this experiment, comparing to the previous, the student profile has had the values of 
the processing dimension reversed. Therefore, in this experiment we had the value 0.9 
for the active learning style and 0.1 for reflective, which resulted in the following: Sensi¬ 
tive 0.70; Intuitive 0.30; Visual 0.55; Verbal 0.45; Active 0.9; Reflective 0.1; Sequential 
0.2; Global 0.8. 

This change caused the learning object with code 10 to be the most relevant for the 
student, as shown in Fig. 5. This change in the recommendation is due to the fact that 
the learning object with code 7 (best recommended in the previous experiment) lost its 
relevance, by presenting reflective characteristic, and does not meet strongly active stu¬ 
dents. Thus, the probability of 90% for the active LS in the current experiment causes 
the learning object with code 10 to be the most relevant. 

The results obtained in this section allows us to conclude that the presented approach 
satisfies the goals originally proposed, and can be deployed and used in existing LMS 
(Learning Management Systems). The experiments resulted on effective personalized 
recommendation, taking into account the student’s learning styles with probabilistic va¬ 
lues. As students probabilistic learning styles do not remain constant over time (they are 
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Learning Objects 


Id 

Title 

Description 

Keywords 

Structure 

Format 

Interactivity 

Learning 

Resource 

Tvpe 

Difficulty 

Eft. 

10 

David Hcffcs 
residency 

David Hoffos 
working with high 

s 

education students for 
high scho... 

network 

video/quicktime 

active 

lecture 

N/A 

465 

7 

Working at a 

Dig Site Video 

This short video 
is about indivi 

paleontology, 

sdq_2one_paleonto 

network 

video/movie 

expositive 

exercise 

N/A 

430 

9 

David Hoffos 

interview 

a ten minute 

interview with 

Davi.. 

education students for 
high scho... 

linear 

video/quicktime 

active 

narrative 

text 

N/A 

405 

14 

i2i 

A girl wearing 
stilts who isfol 

girl, stilts, piano, 
music, musi. 

N/A 

video/quicktime 

mixed 

lecture 

N/A 

395 

8 

A Teddy Bear 
Picnic 

This film is about 
a teddy bear 

teddy bear, picnic, run. 
sandwhi 

linear 

video/quicktime 

expositive 

simulation 

N/A 

370 

5 

Sunspots 

Astronomers used 

the one-metre s 

sunspot solar 
photography, Astro 

N/A 

image/jpeg 

expositive 

figure 

N/A 

340 

0 

A Virtual Field 
Trip of the 
Land... 

Hop in and join 

Dr Ralph {alias 

Sciences Biology: 
Ecology. Scie 

network 

text/html 

N/A 

graph 

N/A 

340 

11 

Polynesian B8y 

A photograph of 
a bay near 

Raiet. . 


N/A 

image/jpeg 

expositive 

figure 

N/A 

340 

26 

Polysemy; 
English 1 

This exercise 
helps user to 

deve... 

homophony, polysemy, 
semantics 

linear 

text/html 

N/A 

exercise 

easy 

305 

21 

Literature of 
the Contact 
Zone -... 

This object is to 
make available 

literature. Sonny 

Sahib. Sarah. 

network 

text/html 

active 

N/A 

N/A 

295 

29 

The Streetprint 

Engine 

Creating.. 

Creating 
empowered 
digital colie 

sharing, research, 
digital colie 

network 

text/html 

N/A 

exercise 

N/A 

295 

12 

Who Killed 

William 

Robinson’ 

William 

Robinson was a 
real pers... 

Arts History: Canadian 
History 

linear 

text/html 

N/A 

diagram 

N/A 

270 


Fig. 5: Recommendation of LO resulted from the third experiment. 


updated automatically and dynamically throughout the teaching-learning process), it is 
possible to notice that this process has a non-deterministic feature. 

The validation of the proposed approach through a prototype for tests, in which we 
can enter the student’s LS freely, was essential for the completion of this work, conside¬ 
ring how much resource and time should be required for the implementation and test of 
it in a e-learning system. 

Therefore, it is necessary to evaluate models before using it in a LMS, due to the 
complexity involved in this type of project. This need becomes even more evident when 
analysing the demand for this type of resource (Graf and Kinshuk, 2010). The next sec¬ 
tion presents some conclusions and future works. 


6. Conclusions, Contributions and Future Work 

This paper presents a practical approach to effective and automatic recommendation of 
LO according to LS, considering the model of Felder and Silverman. This work consi¬ 
dered the IEEE LOM, and used it to perform personalized recommendation of LO ac¬ 
cording to specific students LS. 

The main contribution of this work is to achieve an efficient approach for mapping 
characteristics of LO to students’ LS dynamically and automatically, in order to provide 
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personalized teaching process. This demonstrates the possibility of automating the lin¬ 
king between LO and LS when using the IEEE LOM and the Felder and Silverman LS 
model (Felder and Silverman, 1988). 

In this context, a central contribution of this work is the set of rules presented in 
section 4, which may be easily implemented in any programming language, and used to 
provide adaptation in any learning environment. 

Another important contribution is the LO ranking process, which uses a relevance 
calculation method presented in section 4. Ranking LO according to LS is an important 
issue, considering that, in most of the times, more than one LO can be used to present 
the same content. 

As a result, a rule based expert system has been implemented, and this paper depicts 
its functioning and presents the complete set of rules of the recommendation system. 
In addition, an important result is the ordering of LO according to their relevance for 
a specific student profile. The probabilistic modelling of LS used in this work was of 
fundamental importance for this result. 

The main challenge faced was to establish the relationship between LS and LOM, 
presented by Table 2. This mapping demanded much research and time, requiring study 
and comprehensive analysis of large content. 

The prototype used for experiments, presented in section 5, was of fundamental im¬ 
portance to the work, because it allowed us to easily observe, in details, how the pro¬ 
posed approach behaves in different situations. 

As possible future work, it is being analysed the use of more IEEE LOM fields for 
filtering learning objects. In this way, we have the intention to consider other aspects 
than LS for recommending content. 

In a second step, this work will be deployed on an existing LMS, generating the 
probabilistic student model and returning the most relevant learning objects for real stu¬ 
dents. Therefore, will be held evaluating the appropriateness of the proposed model for 
the interests of real students, the possibility of inconsistencies between the recommended 
learning objects and what they are looking for at one point of their learning process. 
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